Papers with Linguistic Minimal-Pair Benchmark
CxMP: A Linguistic Minimal-Pair Benchmark for Evaluating Constructional Understanding in Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Understanding language acquisition in language models remains an open question, yet many benchmarks focus on grammatical acceptability, with far less attention to interpreting meanings conveyed by grammatological forms. |
| Approach: | They propose a benchmark to evaluate constructional understanding in language models using a controlled minimal-pair. |
| Outcome: | The proposed benchmarks show that understanding of constructions develops more slowly and remains limited even in large language models (LLMs). |